The Task Rehearsal Method of Sequential Learning
نویسندگان
چکیده
An hypothesis of functional transfer of task knowledge is presented that requires the development of a measure of task relatedness and a method of sequential learning. The task rehearsal method (TRM) is introduced to address the issues of sequential learning, namely retention and transfer of knowledge. TRM is a knowledge based inductive learning system that uses functional domain knowledge as a source of inductive bias. The representations of successfully learned tasks are stored within domain knowledge. Virtual examples generated by domain knowledge are rehearsed in parallel with the each new task using either the standard multiple task learning (MTL) or the MTL neural network methods. The results of experiments conducted on a synthetic domain of seven tasks demonstrate the method's ability to retain and transfer task knowledge. TRM is shown to be eeective in developing hypothesis for tasks that suuer from impoverished training sets. Diiculties encountered during sequential learning over the diverse domain reinforce the need for a more robust measure of task relatedness.
منابع مشابه
Comparing Bandwidth and Self-control Modeling on Learning a Sequential Timing Task
Modeling is a process which the observer sees another person's behavior and adapts his/her behavior with that which is the result of interaction. The aim of present study was to investigate and compare effectiveness of bandwidth modeling and self-control modeling on performance and learning of a sequential timing task. So two groups of bandwidth and self-control were compared. The task was pres...
متن کاملThe Consolidation of Neural Network Task Knowledge
A fundamental question of any life-long learning system is addressed: How can task knowledge be consolidated within a long-term domain knowledge structure for efficient storage and for more efficient and effective transfer of that knowledge when learning a new task. A review of relevant background material on knowledge based inductive learning and the sequential transfer of task knowledge using...
متن کاملPseudo-Recursal: Solving the Catastrophic Forgetting Problem in Deep Neural Networks
In general, neural networks are not currently capable of learning tasks in a sequential fashion. When a novel, unrelated task is learnt by a neural network, it substantially forgets how to solve previously learnt tasks. One of the original solutions to this problem is pseudo-rehearsal, which involves learning the new task while rehearsing generated items representative of the previous task/s. T...
متن کاملA Compilation of Annotated Bibliographies
This paper extends prior work on knowledge consolidation and the stability-plasticity problem within the context of a Lifelong Machine Learning (LML) system. A contextsensitive multiple task learning (csMTL) neural network is used as a consolidated domain knowledge store. Prior work has demonstrated that a csMTL network, in combination with task rehearsal, can retain previous task knowledge whe...
متن کاملThe Task Rehearsal Method of Life-Long Learning: Overcoming Impoverished Data
The task rehearsal method (TRM) is introduced as an approach to life-long learning that uses the representation of previously learned tasks as a source of inductive bias. This inductive bias enables TRM to generate more accurate hypotheses for new tasks that have small sets of training examples. TRM has a knowledge retention phase during which the neural network representation of a successfully...
متن کامل